A nonparametric approach to 3D shape analysis from digital camera images - I

This article for the first time develops a nonparametric methodology for the analysis of projective shapes of configurations of landmarks on real 3D objects from their regular camera pictures. A fundamental result in computer vision, emulating the principle of human vision in space, claims that, generically, a finite 3D configuration of points can be retrieved from corresponding configurations in a pair of camera images, up to a projective transformation. Consequently, the projective shape of a 3D configuration can be retrieved from two of its planar views, and a projective shape analysis can be pursued from a sample of images. Projective shapes are here regarded as points on projective shape manifolds. Using large sample and nonparametric bootstrap methodology for extrinsic means on manifolds, one gives confidence regions and tests for the mean projective shape of a 3D configuration from its 2D camera images. Two examples are given: an example of testing for accuracy of a simple manufactured object using mean projective shape analysis, and a face identification example. Both examples are data driven based on landmark registration in digital images. © 2009 Elsevier Inc. All rights reserved.